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ANALYSIS OF VIETNAMIZATION: 
HAMLET EVALUATION SYSTEM REVISIONS 
SUMMARY 


The objeccive of the research presented here was to determine recommenda- 
tions for a revised Hamlet Evaluation System (HES). A reduction in the number of 
questions is desirable for obvious reasons. Changes inthe organization of ques-. 
tions into submodels and models may also be appropriate. Finally, a revision 
which will not lose continuity with the old data is especially desirable. 


Factor analysis and comparison to the structure implicit in existing sub- 
models was the basic method employed. The interpretation of the resulting factors 
included some specific comments on existing models and questions. A recommen- 
dation for retention of 34 questions organized in 10 submodels is presented along 
with the moathly scores for the July 1969-October 1972 period. A series of map 
plot summaries illustrates the application of the revised system to monitoring the 
changes which have taken place since December 1971. 
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INTRODUCTION 


an Lee 


i There has been well founded concern over the future of the HES. Part of 

: this concern is over whether the Vietnamese can or will desire continued reporting 

of so much information in the post cease fire period. Another aspect of concern 

is the validity of the output. While the mechanism has provided a wealth of a 
information for managers and policy analysts, those familiar with the HES and its 

uses are well aware of its shortcomings and abuses. Most of these inadequacies ; x 
have been documented and need not be reviewed; there is, however, general agree- se 
ment that improvements are possible in both selecting questions and structuring 

i. the models and submodels into which those questions are combined. 
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i Some question evaluation work has been dune which assumed the various sub- 
' models and models in the HES validly summarized the usetul information contained 

t in the question responses. These models were used in the evaluation to assess each 
question's contribution to the summary scores. The effort was also Jimited in 

Hq scope and time to eight sample provinces for two quarterly reporting periods (6 
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plication of an ordinal scale to the HES/70-71 question responses (see Appendix A) 
allow the analysts to asseges data over long periods of time (in the following report 
30 months) and to consider the effects of relationships found in all 44 provinces. 
Piev.2us work by Bendix demonstrated that factor analysis of a 58-variable subset 
from HES/70 identifies major dimensions which are substantially different from 

| the models used in the HES. This previous comparison was made by simple visual 
[ 


cl Slt 


months). 
Bendix programming and analytical techniques and the Bendix developed ap- 


inspection. The following analysis employs a more rigorous comparison and is 
based upon a refined variable list. 
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In order to utilize the present submodels and models as a basis for this 
critique, the dimensional structure (i.e., factors) of the time series variance con- 
tained in the responses is rotated to a best fit with the structure implicit in the 
grouping of questions in 16 of the level 1 submodels shown in Figure 1. Table 1 
represents this implicit structure for the 58 questions for which data are avail- 
able. This rotation to fit the ''targets'' represented by the table alters only the 
frame of reference for interpreting the factor analysis. Instead of having the 
reference vectors determined by the strongest pattern of common variance, the 
factor comparison process substitutes some expected patterns — in this case the 
structure implicit in the HES/70. 
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Figure 1 HES/70 Model Relationships and Component Questions 
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Level 1 Submodel Strut 


HEALTH ECO-ACT EOUC 
9.00 0.9 8.0 
0.0 0.95 0.2 
3.0 0.9 0.9 
0.0 0.0 9.0 
9.0 0.0 0.0 
0.0 0.0 7.0 
0.0 0.0 0.0 
0.9 0.9 0.0 
49.9 0.9 0.90 
7.9 0.0 0.9 
1.999 0.9 0.0 
t2.909 0.0 0.9 
1.90) G.9 0.0 
1.090 0.9 0.0 
{.90¢ 0.9 0.0 
y.0 9-9 1.90 
aes 0.0 1.990 
Oecd C.? 1.901 
0.0 0.9 1.00 
0.4 1.990 . 
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4 

= Interpretation of these results sheds light on three subjects: 4q 
4 | 
ig ® The "niceness of the fit'' of the information reported from July 1969- x 
ie December 1971 to the theoretical structure underlying the HES/70-71 4 
‘ models. 4 
‘ @ The number of models and submodels that most appropriately and suc- 4 
z cinctly summarize the data, and the proper grouping for different HES 4 
: questions in those models. a 
| 

‘ a 
: e The usefulness of individual questions themselves. 4 
\ Following this evaluation, a revised grouping of questions into models and E 
: submodels is presented, along with the province scores on these measures for the 3 
oc July 1969-October 1972 time frame (see Appendix B). These measures should be 4 
: more sensitive than the present mode! or submodel scores. This occurs because a 
the measures in the revised models tend to vary together producing a clearly de- 4 

fined dimension, much like re-enforcing sound vibrations produce a harmonious and 5 

: distinct tone wh.le vibrations which are not in phase render only dissonance or 4 
i noise. Any inappropriate combination of questions will reduce much of the infor- 3 
: mation inhcrent in the questions to such noise. “a 
‘ == 
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FINDINGS 


From a comparison shown in Table II of the actual factor loadings with the 
implicit level 1 structure, the following series of observations and recommenda - 
tions regarding specific questions included in this study can be made: 


’ 


4 
“a 
a 
a 
“=z 
a 
= 
I 
a 


4 e Thc variable dealing with law enforcement, HQD-2, fails to define a 
separate dimension and is, if anything, part of a mcre general admin- 
istrative presence concept. The question should either be combined with 


other administrative indicators or eliminated. 


@e The tiequency of GVN technical cadre visits, VQN-5, is presently as- 
sociated with economic development efforts, but its actual variation indi- 
cates that it is more a part of the psyops and information effort. 


wa MIS ot. tn 


HMD-1, civilian casualties, and HMD-2, enemy-caused damage, are 

presently considered in two submodels, Enemy Military Activity and the 

Impact of Military Activity. The two questions fit well into the activity 

rnodel but not in the impact model. The civilian casualties measure is 

also associated with HMB-5, B-6, B-8, and D-7 ~ variables which seem =f 


ee ee 


Enemy presence, HMB-4, does not fit wel’ within the submodel to which _ 
it is assigned and its deletion would simplity and enhance variation in the 


2 avi teat ate att 


model. 


Ghoti a 


In terms of the 16 level 1 submodels, the following conclusions and impli- 


cations for a modified system apply: : 


@ ADMIN — There is a distinet administrative dimension wnich scems to 
have been fairly accurately captured by the existing submodel except for: 


HQE2 Hamlet Chief Presence, which probably contained too little : 
variance to add much useful information. 7 


VQL1 Information/Chieu Hoi Cadre. 4 
HOQD2 Law Enforcement. 
| VQF7 RDC Sleeping Lecation. 


HMB1 Enemy Control of Hamlet. 


- ~all of which were used in other submodels. 


Table I 
Comparison of Implicit Model Matrix with Factor Mats 
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For the modified system, it 1s recommended that the following questions 
be retained and combined for the ADMIN submodel: 
VQE4 Village Chief Presence. 
VQE2 Elected Village Council. 
VQE3 Elected Village Chief. 
VQE7 GVN Tax Collection. 


e POL-MOB — The.e also appears to be a distinct dimension of political 
mobilization which was measured by the present submodel except for: 


VQR2 Secondary School Attendance. 
VQBI1 Village Level VCI. 

VQN1 Self-Development Activity. 
VQF7 RDC Sleeping Location. 


—all of which were used in other models, but actually reflect aspects of 
political mobilization. 


The recommended new submodel should include: 
HQC6 % in PSDF. 
VQF1 Village Council Open Meetings. 
HQF2 % in Government Service. 
HQF6 % in ''Peoples'! Groups. 


e EN-MIL-ACT — The submodel for enemy military activity appears to have 
been « useful distinction from political activity except for: 


| HMB6 Non-Selective Terrorism, which went with both types of enemy 
activity. 


HMB4 Presence of Enemy Military Forces and 


fs HMB1 Enemy Control of Hamlet, both of which were not well as- 
sociated with enemy military activity. 
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While wishful thinking might anticipate this submodel wili soon be over- 
taken by events, the following questions are recommended for retention: 


HMD) Civilian Casualties. 
HMD2 Enemy-Caused Damage. 


HMB2 Attacks Against Local Forces. 


EET TR PORN | MT RINT iy cmpneae 


HMBE3 Intensity of Enemy Activity. 
DEV-ASST — There is a dimension which represents the level of develop- 
ment assistance provided and the existing submodel was accurate except 


for: 


VQNS Technical Cadre Visits, which was more closely associated 
with info-psyops activity. 


The questions recommended for retention are: 


VQNI Self-Develooment Activity. 


VQN2/3 Sclf-Development Retardation. 


VQN4 Public Works Projects. 

HON] Participation in Self-Development. 
PUB-HEALTH — Although there are indications that public health and 
education are essentially concepts which vary together, it appears useful 
to continue to distinguish between the two in the level 1 submodels as 
follows: 
Public Health submodel: 

VQP3 Hospital/M.D. Available. 

HQP1 Medical Services Available. 


VQI1/2 Dispensary or Maternity Clinic Available. 
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Education submodel: 


VQRI1 Secondary School Available. 
VQR2 % Attending School. 
VQR2 % Completion of Primary Education. 


ECON-ACT — Economic activity was only moderately associated with 
the questions in the existing submodel. It was interesting to find that 
primary school availability was also a weak indicator of an economic 
dimension. A level 1 submodel consisting of the following questions should 
be retained: 4 


ia 


VQLI Availability of Commodities other than rice. 


VQL2 Availability of Manufactured Goods. 
HQLI Market Development. 
EDUCATION — Previously noted with public health. 


EN-POL-ACT — As noted for enemy military activity, there are distinct 
dimensions for military and political aspects of enemy activity. As could 
be expected, it was found that non-selective terrorism and civilian 
casualties are associated with both and thus might be deleted to enhance 
the distinction. The questions recommended for the revised submodel 
are: 


aii bi wl as iil, ya, Littell a al ie liu, 


HMB5 - Selective Terrorism. 


he 


HMB7 - Incidents Against Non-Military Targets. 

HMB8 - Enemy Propaganda Activity. 
EN-POL-PRS — While there were several exceptions to the way in which 
this dimension was captured by the present submodel, it should be re- 
tained with the following questions: 


HQB1 Hamlet VCI. 


VQB1 Village VCI. 
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HQB2 Enemy Tax Collection. 


HQB3 % Participation in Enemy Activities. 


@ INFO-PSYOPS — GVN information activities form a unique pattern as 


expected by the existing submodel. Jt was noted that tech cadre visits are 
associated with this pattern, but this probabiy reflects a weakness in the 
administration of technical assistance rather than en aspect of informa- 
tion activity. Retention of the submodel with the following Guestiona is 
recommended: 


VQG2 Movies/Cultural Drarna Exposure. 
VQG3 Information Cadre Visits. 


EN-MIL-PRS — The one question used inthis submodel did not fit this 
implicit dimension at al) nor did any other questions. Deletion of the sub- 
rnode] is possible as far as the 58 questicns analyzed are concerned. 


PSDIF-ACT — Again no strong associations emerged and apparently PSDF 
activity as a submodel adds little or nothing usoful. Deletion is recom- 
mended, 


IMP-MIL-ACT -= This is another submodel which appears to be necessary. 


FRN-MIL-PRS — The presence of only one question in the data analyzed 
makes it difficult to judge this sub i1odel as well as the three preceding 
submodels. However, for purposes of how the HES is used to evaluate 

the situation in the countryside, it is clear that better information is avail- 
able from operational sources. 


LAW-ENFRC -— The variance or information going into this submodel ap- 


peare to be redundant since the same information is already incorporated 
in the ADMIN dimension. 


RDG — This submodel should also be deleted, as the available information 
scems to belong more appropriately in POL-MOB and/or DEV-ASST sub- 
models. 


These observations and recommendations are based on a 58-variable HES 


Obviously, some variables and submodels which did not fit with others in 


this analysis might well be appropriately combined with some of the questions not 
included. A more cornplete data set would not, however, affect the low loadings of 
these variables inappropriately combined into the various submodels or models. 
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APPENDIX A 
AN ORDINAL SCALE FOR HES DATA 


The approach taken to scaling the HES data greatly enhanced the analysts! 
methodological options by avoiding the use of letter scores. Inthe scheme em- 
faoyed, each possible response to the individual HES questions was given a weight 
between 0 and 4. Zero represents the worst or least desirable conditions for the 
GVN while a 4 indicates the best or most desirable conditions. For those questions 
pertaining to VC/NVA, the same scale was applied; againa 0 indicating the least 
desirable condition from the VC/NVA point of view and a 4 representing the best 
possible circumstance or greatest amount of VC/NVA presence and activity. The 
figure below represents the scaling concept used in this analysis. 


Positive GVN Positive VC/NVA 
Presence or Activity Presence or Activity 


4 3 2 1 0 1 2 3 4 
No presence or activity by GVN or NVA/VC 


Examples of the application of this scale appear below: 


linemy- Caused Damage 


Scale 
Weight 
HMD2-0 = No damage 4 
HMD2-1 = Minor damage 3 
HMMD2-2 = Sevious damage 1 
HMD2-3= Widespread damage 0 
Participation in Peoples Groups 
: Scale 
Weight 
HQF6-0 = None 0 
HQF6-1 = Yes < 10% 1 
HQF6-2 = Yes 10 40% 2 
HQF6-3 = Yes 41-90% 3 
HOF7-4 = Yes > 90% 4 
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After the individual variable scores were compiled, several questions were 
then combined into various indices; e.g., VOL 1, VOL 2, VQL 3, and HQL 1. 
All these questions, which pertain to economic conditions, were combined into an 
index of economic strength. Factor analysis was employed to assess the validity 
of the indices. This technique indicates the extent to which each of the variables 
measures a statistically common and distinct dimension. 


A strong confirmation of index validity is obtained when its component vari- 
ables load on the same factor or have a similar loading distribution across several 
factors. This technique was employed to reconstruct the indices, i.e., to add and 
delete variables from the various indices, depending on the strength of the variables 
loading on a facto: which best represented the index in question. 


ILLUSTRATION 


The best way of determining the value of the recommended shorter and 
reorganized HES is to present an example of how it could have been used. A goud 
one is the December 1971 through October 1972 period, because anyone who has 
been using the existing HES reports is familiar with the impact of the offensive 
on pacification. 


This illustration uses summary map plots for December 1971 and March, June, 
and October 1972. The individual province scores are used to categorize the 
province-month observations according to quartile of the July 1969-October 1972 
distribution of scores. This use of the total data sample as a reference standard 
facilitates month-to-month evaluation of changes observed. In contrast, the first 
set of maps shown in Figure 2 uses only October 1972 distributions to categorize 
the provinces by quartile. Incidentally, the use of quartiles is arbitrary. One 
could also use halves, thirds, or deciles. It is simply a device for reducing 44 or 
more values to a few readily observed categories. As can be seen in Figure 2, 
five model scores are being used in this illustration: (1) Pacification, (2) Political 
Mobilization, (3) Social-Economic Conditions, (4) GVN Presence and Activity, and 
(5) Enemy Presence and Activity. The summary format of Figure 2 is an easy way 
to view the relative status of the provinces on each measure at any point in time; 
but it says nothing about trends. 


Figures 3 through 7 permit an evaluation of the trends. The combined pacifi- 
cation scores shown in Figure 3 present a rather simple overview of what has 
happened. Some declines can be noted already in March (Quang Tri, Thua Thien, 
Quang Nam, Darlac, Kien Hoa, and Chuong Thien). The obvious major impacts 
of the offensive in Quang Tri, Kontum, Binh Dinh, Binh Long appear in the April, 7 a 
May, June, and October maps. However, it can also be seen that the situations in 
Quang Ngai, Pheu Yen, Long Khanb, Binh Duong, Hau Nghia, Long An, Chou Doc, 
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Vinh Binh, Chuong Thien, and An Xuyen become worse and have not yet recovered 
as in Quang Tin, Darlac, Khanh Hoa, Phuoc Tuy, Kien Phong, and Kien Hoa. 


An exainination of Figures 4 through 7 provides more detailed information. 
Figure 3 tells generally how the situation is going. The four lower level models 
can give an idea of why changes are taking place. For example, we note that a 
pacification decline between December 1971 and March 1972 took place in six 
provinces. Figures 7(a) and (b) show Enemy Presence and Activity account for the 
declines in Quang Tri, Thua Thien, Quang Nam, Darlac, and Kien Hoa. The 
decline in Chuong Thien comes largely from a drop in Political Mobilization — an 
interesting fact because Chuong Thien is the only Delta province remaining low on 
Social-Economic Conditions. 


Figures 7(a) and (b) also reveal the danger in looking at only the overall com- 
bined pacification scores to monitor the situation. In these figures we see an in- 
crease in Enemy Presence and Activity model is quite significant because it is the 
product of only general district level observations of events and conditions at the 
point where they impact on the population, not the direct product of a sophisticated 
intelligence collection and analysis system. 


Numerous other interesting tidbits can be gleaned from these summary dis- 
plays. More could be observed by going down to the various submodels, but it is 
believed that the utility of the revised system has been demonstrated. 
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Figure 6 GVN Presence and Activity, 
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APPENDIX B 


REVISED HES SCORES, RANKINGS, AND 
DISTRIBUTIONS; JULY 1969-OCTOBER 1972 


This appendix consists of the data which would have been obtained using only 
the 34 questions of the recommended HES. Scores have been computed for all four 
levels of models. In the following pages, 10 months of data by province are listed 
on each right-hand page. The facing left-hand page is a listing of the corresponding 
monthly rankings for eich province. Following the 8 pages of data and ranking for 
each subrnodel or mod] the distribution of those scores is shown in a histogram. 


This lengthy presentation is included for two reasons. It demonstrates that 
the recommended revisions are possible without loss of continuity in the time series. 
And finally, someone with the time and resources could find it a rich data source 
for further analysis and under standing of the war. 
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